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Summary  of  research  under  AFOSR  Contract  #F49620-91-C-0080 


Porsouiicl:  Joe  Halpern  (PI),  Nir  Friedman,  Adam  (.Uovr.  DajdiiH'  Kollor 

The  research  performed  nnder  tliis  contract  can  Ix'  ion,G,hly  divi<h'd  into  fonr  areas: 

Coixi{)U ting  <l<^groc8  of  holicfi  Consider  an  agc'iit  (or  (’Xp('rl  sys(<'m)  with  a.  knowledge  base 
KB  that  includes  statistical  information  (snrh  as  ^'^0%  of  patients  with  jaundice  have 
hepatitis"')  who  would  like  to  assign  a  dc<jrcr  of  hrlu\(  to  a  partirnlar  statement  ip  (such  as 
“Tom,  a  patient  with  jaundice,  lias  hepatitis").  For  examphc  a  dorlor  may  want  to  assign 
a  degrees  of  belief  that  a.  patient  lias  a.  particular  illiu'ss  baso<l  on  the  symptoms  exhibited 
lyy  the  j)a.tieiit,  togetlier  with  general  information  about  symptoms  and  diseases.  Since 
the  actions  the  agent  takes  may  depend  (  i  iu  ially  on  lliis  (l('gi<'e  of  belief,  we  would  like 
techniques  for  com])nting  degrees  of  belief  in  a  priiK'iphvl  maniuM.  We  have  investigated 
three  methods  of  doing  so.  All  three  methods  are  apj)Ii<  ations  of  the  “principle  of  in- 
diffeixMice",  because  they  assign  equal  d('gre('  of  lH'li('f  all  l)asi(  “situations  consistent 
witli  the  knowh'dge  base.  They  differ  becaus<'  theia'  ao'  <<)mpo(ing  intuitions  about  what 
the  basic  situations  are.  V'arious  natural  patl<'rns  of  o'asonint;.  such  as  tlie  preference 
for  the  most  sixecdhc  statistical  data  a.vailabh\  turn  out  to  follow  from  some  or  all  of  the 
t('chniques.  'This  is  an  improvement  over  earli<'r  lli<'ori('s.  sucli  as  work  on  direct  inference 
and  refeiamce  classes  (going  back  to  the  1f)3()'s)  which  arlfilrarily  postulate  tliese  patterns 
without  offering  any  dee[)er  ex])lanations  or  gua rant<M'-:  of  < onsist (mey. 

'The  three  methods  we  investigate  have  surj)rising  rha i a(  (aM i/a tions,  that  show  their  rela¬ 
tionships  to  other  approaches  to  obtaining  d('grees  of  befud.  for  (’xainple,  one  approach 
is  strongly  related  to  maximum  entropy  (and,  ind(H’d,  can  Ix'  vi<'W(Hl  as  a  generalization 
of  it),  wliile  another  can  be  shown,  roughly  speaking,  tfi  maximi/<*  independence  among 
predicates  as  much  as  possible.  There  are  also  n tH'Xpoett’d  <dnn<'rtions  between  the  three 
approaches,  that  help  us  understand  why  llx'  spoeifir  languagf'  rhos<'n  (for  the  knowledge 
base)  is  miK'h  mor<"  eritical  in  inductive  rcMsoning  of  1  Ix'  ^or<  \v('  consider  than  it  is  in 
tradilT)nal  deduf‘tiv(^  reasoning. 

One  of  (lie  applications  of  this  framework  is  to  (bda.iiM  ro;tsoniug.  Suppose  we  caj)ture  a 
d('fanll  such  as  “tyj)ica,lly  birds  fly"  as  tlu' st a( ist iral  statomonl  edmost  100%  of  birds  fly  . 
If  W(^  iixJiide  snrh  d('fa,ults  in  the  KB,  tlxm  w('  an (omaf irally  got  som<'  of  the  propraties 
that  have  been  most  sought-after  in  d(daul(  formalism^,  iix  luding  preference  for  more 
spr’rifir  information  and  a.bility  to  ignore  ir  r^-hea  n(  in  hu  i!ta  ( ion .  '1  1h'  iiH'thods  can  a1s(j 
be  extcMuled  to  do.ij  with  causal  reasoning  in  a  nalnial  wav.  1  hus,  our  apj^roa.rh  can  be 
used  for  a  wide  spertrnm  of  reasoning:  qua  nt  it  a  t  i\'('.  cf  ualit  a  I  i  vi'.  ;)n<l  rausal. 

All  thre<'  methods  uHMitioned  above  can  b^’  vi<'W(Ml  « diti  i  bh'  with  a.  Ha.yt'sian  ap¬ 
proach.  which  savs  start  with  a.  prior  probability  aii<!  cmiditinn  whatever  information 
you  rec<'iv<\  dJie  piatblem  with  the  Bayesian  a|)proacli  \<  that  it  do('S  not  tell  ns  what 
spare  td  take  a.  prior  over,  or  what  that  prior  should  In'.  Our  work  can  be  viewed  as 
answering  these  questions.  Once  we  fix  our  /e/yy//e//r  (wImm<\  t^ch nically,  the  language 
consists  of  consta.nt  symbols,  function  symbols,  and  pia'dicat^'  symbols,  as  in  first-order 
logic),  a.  possrhlf  v-orld  just,  defines  a.  ])ossibI<'  interprot  at  ion  he-  all  the  symbols  in  the 


language-.  That,  is,  if  the  la.ngiia.go  indneles  the  prediratf'  syinlxils  ffcpaltiis  and  Jaundice, 
and  the  constant  7V)7?/r,a.n  interpretation  descrihes  which  indivielnals  have  licpatit.is,  wliich 
ones  have  jaundice,  and  which  one  is  loin.  V\e  put  a.  prior  on  the  set  of  possible  worlds. 
Our  focus  has  been  on  priors  that  satisfy  somh'  uuihuinily  e'ouditions,  aiKl  our  results 
show  that  they  have  quite  attractive  |)r()pert i('s.  11ow(’V(m.  <uir  results  also  show  that  they 
are  not  always  appropriate.  More  recently,  rather  than  ‘onsi<loring  a  j^articnlar  prior,  we 
have  considered  the  question  of  what  proporti<‘S  of  priors  give'  us  desirable  properties  of 
beliefs  (such  as  allowing  us  to  ignore  irrehnatit  information).  \V<'  are  also  beginning  to 
consider  algorithmic  aspects  of  this  approach. 

Papers  A2,  A3,  A1,  Afi,  R1.  R2,  R3,  R1,  R3.  Rtb  R<).  RRi.  R17.  (^3,  and  summarize 
our  work  in  this  area. 

Reasoning  about  knowledge  and  eoininnni<*ation;  A  i<‘<a'nt  tr<'nd  in  analyzing  compli¬ 
cated  svstems  has  been  to  thifik  in  terms  of  oiu'  agent  knows  about  what  other  agents 
know,  and  how  this  knowh'dgf’  changes  as  a  result  <d  <  om muibn  a tioi\ .  Under  this  con¬ 
tract.  we  have  (a)  shown  that  this  approach  (and  tho  huinal  modtd  of  systems  tiiat  goes 
along  with  it)  can  be  used  to  capture  asjK'cts  of  knowh'dg('  bas<‘s  moix’  elegantly  and  con¬ 
cisely  than  the  traditional  axiomatic  approach,  (b)  |)rovid('<l  a  formal  logic  for  aimly/dng 
commtinication  and  knowledge  change,  and  (<  )  provid<Ml  a  logi(  that  captures  the  more 
computational  aspects  of  reasoning  al>out  knowIe(lg('.  I  his  lattcn  problem  is  a  longstand¬ 
ing  one,  since  it  is  w('ll  known  that  the  standard  mo<l<'ls  fnr  if'asoning  about  knowledge, 
using  possibh'- world  structno's,  s^ifTer  from  tho  problom  of  ov)  insriencr:  agents 

know  all  tan tologi(^s,  and  the  logical  cons('(piences  of  thoir  knowh'dge.  Our  model  cap¬ 
ture's  the  algorithms  used  by  agents  to  <'ompnte  their  knowle<lgo  in  a  elirect  way;  most  of 
the  previous  attem])ts  to  solve  the  prob]<’m  f'an  In'  <'mb(Ml<Ied  in  our  solution  in  a  natural 
way.  riius,  our  aj^proaedi  can  be  viewed  as  a  g('n(’rarr/a  I  ion  of  thorn  all.  1  he  work  in  this 
a rea  is  su m ma.rizf'<i  in  papers  A  I,  R3,  RIO,  and  RI5. 

Noun loiio toil i<!  r<^nsoii  1  ngt  V\'hile  a.  gr(''at  d<’al  of  work  has  bron  doin'  on  noiimonotonu  lea- 
soning,  almost  all  of  it  has  assumeel  that  tln’O'  is  om1\  a  singh'  ag<'nt.  It  ha.s  bee'ii  a 
longstanding  probh'iu  to  extend  some  of  tlu'  standard  appmachos  to  non nK)not()nic  rea¬ 
soning  to  mnitiph'  agents.  'This  ])roblom  has  now  In'i'ii  solv('d  foi  two  approaches  to  ''oidy 
knowing",  due  to  Levescpie  and  to  Halp('rn  ami  Nbwov.  \'\\r  a])pr<iach  shouhl  extend 
naturally  to  Moor<''s  a  u  t,o('pist<'mic  logic.  In  additi<m.  b\  going  back  to  the  original  eb'fi- 
nitions  of  various  approaedo's  to  non momd-onic  o'ason i m.’ .  w<'  wf'i^'  abh'  to  acquire  a  cleei^ei 
u nderst  a  ndi ng  of  source's  of  potential  ])robl<'ms. 

More  roc'f'iit  iy,  work  was  done  trying  to  pro\  id<'  a  gnu  ral  modf'l  for  non  mononotonic 
K'asoning.  Man\’  nonmonotonic  logics  ha\e  b<'('n  piopo.<'d.  and  there  is  litth'  agO'tuiK'ut 
as  to  what  is  the  'right'  oiu',  or  whet  her  t  here  is  any  'rig lit”  oio'.  1  h<'r<'  is  sonu'  agO'enient. 
on  tie'  otlc'i  haiul,  on  souk'  basic  '"core"  piop('rti<'s  foi  non inonolonic  reasoning.  I 
j)roperties  IiaA'o  b<'<'n  calleci  the  KLM  prop<'rlies  {for  Kraus,  l.-<'li  man  n ,  and  Magidoi). 
Many  dilT('r<’nt  approaclexs  to  nonmonotonic  K'asoning  ha\<'  lu'en  proposed,  all  of  which 
lia.ve  b('en  shown  to  In*  cdiaracteriza'd  by  tie'  Kl.-M  properties  in  tie'  j^ropositional  <;'a.s<': 
including  preferential  logi(  ,  ^-semantics,  jxissibiity  tle'or\,  ;Hel  /.  rankings.  1  his  has  b('<'n 
viewed  as  (piita'  surprising.  Recently,  we  ha.v<'  propos<'fl  a  <pialilative  way  of  ca.f)turing 


likcliliood  tlia.t  we  rail  plousihUiiy  measures.  It  is  straii^litforward  io  show  that  all  the 
approaches  to  giving  semantics  to  nonmonotonic  reasoning  that  can  he  characterized  by 
the  KLM  properties  can  he  easily  mapped  into  plansihility  spac('s.  Moreover,  a  single 
propf’i'tv  r)f  plansihilit-v  is  provided  tha.t  is  lu'cessar^'  and  snffici<’nt  to  gua.ia.ntee  that  the 
KLM  properties  are  sound,  and  another  is  w('al<  pr()p('r(y  is  provich’d  that  guarantees  that 
they  are  complete.  Since  all  the  known  apjooaclH's  ao'  ^'asily  s<'<‘n  to  have  both  properties, 
it  is  no  longer  so  mysterious  that  they  r  an  lu*  (  ha  ract^  i  i/f'<l  by  t  Ih'  I\bM  piopeities. 

'Things  change  signihca.ntly  once  we  mov<'  to  t  lo'  hrsl  ord<M  <  as(\  Using  the  insights 
afforded  by  thinking  in  terms  of  plausibility,  w('  <an  show  that  all  tlie  approaches  alluded 
to  above  other  than  r-,semantics  lack  signifu  ant  (’x {>r<'ssi\ <'  p(»w('r  once  we  introduce  first- 
order  cpiantification.  'These  results  em]diasi/o  lio'  naturaliK'ss  and  a ppropria teiu’ss  of  an 
api^roach  Itased  on  plausibility. 

'The  work  in  this  area  is  summarized  in  paptMs  AT.  (  K  and  (  ti. 

Belief  oUuiigr'*  'I'lie  st  udy  of  la  hcf  cha.vyc  has  Ihmmi  an  af  ii\«'  ao'a  in  philosophy  aiul  in  ai- 
tificial  intr!lligence  and,  morr'  recently,  in  gam<'  th('ot\  I  h<'  fo<  tis  of  this  research  is  to 
understand  how  an  ag<'nt  should  revise^  his  Ix'Iifds  as  a  M'-:nl(  org('tting  new  information. 
In  the  litf'rature,  two  instance's  of  this  gc'io'ial  plH'noneeeMi  hav<'  In'c'ii  stndic'd  in  dc'tail: 
Bfl7ef  rcvfsiou  at  tc'mpts  to  clescril.m  how  an  agc'ut  slooild  .o  <  <un  moda ( ('  a  nc'W  belied  (pos¬ 
sibly  inconsistent  with  his  other  Imbeds)  abe)nt  a  static  wmiT}.  fh  lirf  7/;n/u/c,  on  the' othe'r 
hand,  attc'inpts  to  de'scril)e'  how  an  agc'nt  shonlel  cTiaiov  hi-;  bc’lic'fs  as  a  re'sult  e)f  learning 
a.be)ut  a  change  in  the*  world. 

Belief  revisie>n  and  belief  update  describe*  only  two  ed  th*'  many  seemarios  in  which  beliefs 
change'.  Under  this  contract,  we  have*  eexistnie  te'd  a  ffame'weuh  to  ic’ason  abc)ut  belic'f 
change  in  general.  'The  framework  .starts  starts  with  a  tiame'wenk  intiocluced  eailirir  b\ 
the  PI  and  his  ce)lla])e)rators  fe)r  rease)ning  abcoil  knowl^MltM'  in  multi-agent  .systems.  'Tlie 
frame'work  explicitly  inclucb's  time,  .se)  h'ts  ns  in ve'st ii;a tc'  how  knowledge  changes  ove'r 
time.  VVe*  c'xtend  it  to  include'  belic'fs  anc]  pia  usibilit  i^  - .  using  the'  nebion  of  plausibility 
measure'  cliscussc'd  above'.  Sinc'e  our  frame'work  allov,':  ev'  tc)  talk  about  kuo^^  leKlgc',  be¬ 
lief,  and  time,  it  givc'S  us  a  pe)w<'rful  tool  for  c  a  j)t  u  riiit.\  laiions  notions  of  Ix'lief  change'. 
Many  situations  pre'viously  studied  in  t  he'  li t .a  a  t  u r^s  -le  h  as  •lni<{nn^fu'  rcasonina  and  the' 
pvisoiK  v's  (hlcmiaa  fre^m  game'  theory,  can  bc'  csisily  o;ipjnre‘<j  in  the’  fiame'woik. 

'Idle'  frame'work  can  e’asily  capture'  revision  and  np<la(<  as  spi'cial  ease's,  anc]  give's  ns  a 
mucdi  bc'tte'!'  11  nclc'ist.a  ndi  ng  of  thc'in .  I'T>r  c'xa  m  ph'.  it  biinc*.''  out  leev  update'  pic'fens  tc)de'f('i 
'dibnormalitic's''  to  as  late  a  lime'  as  peissibh'.  an  appicvo  li  v  liioh  is  rarc'ly  a pjMopria tc'  in  A1 
a j)pbca t ions.  More'  rc'ce'utlv,  it  was  shown  (hat  makin,''.  a  cpialitativc'  Miirh'ar  <7ssvmpiiov 
give'S  ns  a.  notion  <d  ix'lic'f  c  hange'  that  is  pc'ihap-  <  In  .. a  ((»  mu  intuitions  than  oIIk'Is 
proposc'cl  in  t  he'  litc'iat  urc'. 

'This  work  is  su  m  ma  rizc'd  in  papc'is  Mil,  H  T -T  BIT  IH  t  i  (.  and  (  >. 
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